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REMARKS/ARGUMENTS 

In the Office Action, the Examiner noted that claims 1-45 are pending in the application. 
The Examiner additionally stated that claims 1-45 are rejected. By this amendment, 
claims 44 and 45 have been amended. Hence, claims 1-45 are pending in the application. 

Applicants hereby request further examination and reconsideration of the application, in 
view of the foregoing amendments. 

In the Claims 

Rejections Under 35 U.S.C. §112, second paragraph 

The Examiner rejected claim 44 under 35 U.S.C. 112, second paragraph as being 
indefinite. Applicants have amended claim 44 to more distinctly claim the alternative 
prediction apparatus. 

Rejections Under 35 U.S.C. §101 

The Examiner rejected claim 45 under 35 U.S.C. 101 as being directed to non-statutory 
subject matter. Claim 45 as amended is directed to statutory subject matter. 

Rejections Under 35 U.S.C. §102(b) 

The Examiner rejected claims 1-16 and 22-45 under 35 U.S.C. 102(b) as being 
anticipated by Patel et al., U.S. Patent No. 6,134,654 (hereinafter, Patel). Applicants 
respectfully traverse the Examiner's rejections. 

As described in the Background section of the instant application, normally programs 
execute subroutine call/return sequences in a standard fashion. The standard fashion is 
that for each call instruction executed to push the return address onto the stack, there is a 
corresponding return instruction to pop the previously pushed return address off the 
stack. Because of the predictability of standard call/return sequences, return stacks 
typically predict return instruction target addresses very accurately. However, the present 
inventors have recognized that certain programs, including important operating system 
programs, do not execute subroutine call/return sequences in the standard fashion. 
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Applicants provide relevant portions of the Background section here for the Examiner's 
convenience: 

For example, code executing on an x86 microprocessor may include a 
CALL, then a PUSH to place a different return address on the stack, then a 
RET, which causes a return to the pushed return address rather than to the 
address of the instruction after the CALL, which was pushed onto the 
stack by the CALL. In another example, the code performs a PUSH to 
place a return address on the stack, then performs a CALL, then performs 
two RET instructions, which causes a return to the pushed return address 
in the case of the second RET rather than to the instruction after a CALL 
that preceded the PUSH. This behavior causes a misprediction by a return 
stack. 

The non-standard call/return sequences cause return stacks to mispredict. 

To solve this problem, Applicants detect when a return stack mispredicts a target address 
of a return instruction a first time, and store in their BTAC an override indicator to 
indicate the misprediction by the return stack (which may have been caused by the 
presence of a non-standard call/return sequence in the program). Then, the next time the 
target address of the return instruction requires predicting, if the override indicator is set, 
the branch control logic selects the target address prediction provided by the BTAC, 
rather than the target address prediction provided by the return stack. 

None of the references cited by the Examiner, including Patel and Gochman, even 
recognize the non-standard call/return sequence problem solved by the present invention. 
Therefore, it is not surprising that they do not provide a solution to the problem. 

Broadly, Patel discloses a branch prediction mechanism that attempts to reduce the 
number of pipeline bubbles introduced in the instruction fetch pipeline of his processor 
by providing a bi-level branch target address prediction mechanism. The mechanism 
makes a fast single-cycle prediction which is used to fetch from the instruction cache. On 
the next cycle, a more accurate two-cycle prediction is made that is compared to the fast 
prediction. If the predictions agree, then the bubble is avoided; otherwise, the fetch 
operation is delayed so that the slower prediction is used to fetch from the instruction 
cache. The delay creates a bubble in the fetch pipeline. Patel discloses two 
embodiments of his bi-level prediction scheme. The Examiner asserts that the predicted 
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select signal 549 output by PatePs branch target address table 518 in the second 
embodiment teaches Applicant's recited override indicator. However, PatePs first 
embodiment will be described here to aid in understanding the second embodiment. 

PatePs First Embodiment 

In PatePs first embodiment, the fast single-cycle prediction mechanism is a next fetch 
address table 506, which stores historical branch information. During the first clock 
cycle, the next fetch address table 506 produces the fast single-cycle target address 
prediction (or simply the next sequential address if the fetched instruction was not a 
branch instruction or a return instruction), in response to a current fetch address 504 
input. 

The slower two-cycle prediction mechanism comprises three main components: 1) three 
target address prediction sources: a next sequential address 516, a return address stack 
514, and a branch target address table 518 that provides two target address predictions 
per fetch group of eight consecutive instructions; 2) a mux 524 that receives the four 
inputs from the three prediction sources and outputs a fetch address to the instruction 
cache 405; and 3) a collection of circuits to generate a select signal 548 to control the 
mux 524. The collection of circuits includes a select generation circuit 526 that generates 
the select signal 548 based on input from a predecode table 528 and a branch prediction 
table 536. 

Each predecode table 528 entry stores the type of the instruction in the corresponding 
instruction cache 405 entry. In particular, the instruction types that may be stored by the 
predecode table 528 are a conditional branch instruction, an unconditional branch 
instruction, and a return instruction. The predecode table 528 maintains a one-to-one 
correspondence between its entries and the entries in the instruction cache 405. When the 
instruction cache 405 is updated with a new cache line, the predecode table 528 is also 
updated with the type information of the instructions in the cache line. The predecode 
table 528 outputs what type of instruction was fetched based on a translation of the 
current fetch address 504 to a physical address and lookup of the physical address in the 
instruction cache 405 tag array 530. Thus, the predecode table 528 always produces an 
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accurate type of the predicted instruction. That is, the instruction type output by the 
predecode table 528 is not a prediction; it is the correct instruction type. In particular, the 
predecode table 528 specifies whether the instruction is a conditional branch, an 
unconditional branch, or a return from function call instruction. 

During a first clock cycle, an instruction is fetched from the instruction cache 405 based 
on a target address prediction provided by the next fetch address table 506 to produce the 
target address prediction (or simply a next sequential address if the fetched instruction 
was not a conditional branch instruction, unconditional branch instruction, or a return 
instruction). The predecode table 528 outputs what type of instruction was fetched. The 
predecode table 528 provides the instruction type to the selection generation circuitry 
526. If the instruction type is a conditional branch instruction, the selection generation 
circuitry 526 also receives information from the branch prediction table 536 predicting 
whether a conditional branch instruction will be taken or not taken based on past history. 
Based on the instruction type information and the taken/not taken information, the 
selection generation circuitry 526 generates the select signal 548 to control the mux 524. 
If the instruction is a return instruction, the mux 524 selects the target address 544 from 
the return address stack 514 input; if the instruction is an unconditional branch, the mux 
524 selects one of the two target address inputs 540/542 provided by the branch target 
address table 518; if the instruction is a conditional branch instruction, and if the branch 
prediction table 536 predicts the conditional branch instruction is taken, the mux 524 
selects one of the two target address inputs 540/542 provided by the branch target address 
table 518; if the instruction is a conditional branch instruction, and if the branch 
prediction table 536 predicts the conditional branch instruction is not taken, the mux 524 
selects the next sequential address input 546; if the instruction is not a conditional branch 
instruction or an unconditional branch instruction or a return instruction, then the mux 
524 selects the next sequential address input 546. 

During the next clock cycle, the address selected by the mux 524 is compared with the 
fast single-cycle fetch address prediction provided in the previous cycle by the next fetch 
address table 506. If the two fetch address predictions match, no pipeline bubble need be 
generated. If they mismatch, then a bubble is created to enable a fetch from the 
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instruction cache 405 using the slower, but more accurate, prediction made during the 
second cycle. 

Patel 's Second Embodiment 

PatePs second embodiment is described with respect to the block diagram of Fig. 5 at 
col. 7, lines 34-57 and with respect to the flowchart of Fig. 7 at col. 8, lines 15-35 1 . In 
the second embodiment, the slower two-cycle prediction mechanism is the same as in the 
first embodiment. However, the fast single-cycle prediction mechanism comprises three 
main components, two of which are the same as the slower two-cycle prediction 
mechanism, namely the three target address prediction sources (the next sequential 
address 516, the return address stack 514, and the branch target address table 518) and 
the mux 524 that receives the four inputs from the three prediction sources. However, in 
the fast single-cycle prediction mechanism of the second embodiment, the mux 524 is 
controlled by a predicted select signal 549 that is provided by the branch target address 
table 518. The predicted select signal 549 is a historic select signal. See col. 7, lines 34- 
42. 

During the next clock cycle, the select signal 548 generated by the select generation 
circuit 526 is compared with the predicted select signal 549 that was output by the branch 
target address table 518 during the previous clock cycle. If the select signal 548 and 
predicted select signal 549 match, no pipeline bubble need be generated. If they 
mismatch, then a bubble is created to enable a fetch from the instruction cache 405 using 
the slower, but more accurate, select signal 548 prediction made during the second cycle. 
The predicted select signal 549 of the second embodiment eliminates the need for the 
next fetch address table 506 of the first embodiment. See col. 7, lines 43-57. 

The Examiner states in the Office Action that the historic predicted select signal 549 
corresponds to Applicants' override indicator recited in claims I, 23, 33, 44 and 45. 
Patel does not state how the historic select signal values stored in the branch target 
address table 518 are chosen. That is, Patel does not state the history from which the 

1 Applicants note that col. 8, line 21 appears to include a typographical error when it refers to "next fetch 
address table 506", which apparently should refer to "branch target address table 518" since Patel explicitly 
states at col. 7, lines 43-47 that the next fetch address table 506 is not used in the second embodiment. 
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"historic" select signal values are derived. Therefore, the Examiner is apparently 
inferring - perhaps in hindsight based on the teaching of Applicant's disclosure - that the 
historic select signal values in the branch target address table 518 are updated based upon 
a history of whether the return address stack 514 mispredicted the target address of a 
return instruction. Applicants respectfully assert that Patel does not teach that the 
historic select signal values in the branch target address table 518 are updated based upon 
a history of whether the return address stack 514 mispredicted the target address of a 
return instruction for at least the following reasons. First, doing so would result in worse 
prediction of return instruction target addresses. Second, Applicants suggest below the 
most likely explanation of how the historic select signal values stored in the branch target 
address table 518 are chosen. Third, it is improper for the Examiner to rely upon a 
reference as teaching a limitation that the reference does not teach, either explicitly or 
inherently. Fourth, Patel does not teach that his branch target address table 518 stores 
target address predictions for return instructions. 

Meaning of "historic predicted select signal" 

First, assume for argument's sake, that the historic select signal values in the branch 
target address table 518 are updated based upon a history of whether the return address 
stack 514 mispredicted the target address of a return instruction, as the Examiner appears 
to infer. That is, assume: 1) that the return address stack 514 predicts a target address of 
a return instruction, 2) that when the correct target address of the return instruction is 
finally determined and compared with the target address predicted by the return address 
stack 514 there is a mismatch, and 3) that in response, PatePs processor updates the 
historic predicted select signal 549 in the branch target address table 518 with a value to 
cause the mux 524 to select one of the branch target address table 518 target address 
predictions 540/542 during the fast single-cycle prediction the next time the return 
instruction is fetched. If this were true, then a bubble would always be created in the 
fetch pipeline - the very thing PateFs invention attempts to avoid, and no prediction 
improvement will be obtained. This is because on the next clock cycle the slower two- 
cycle predicted select signal 548 will have a value that selects the return address stack 
514 prediction since the predecode table 528 is kept in a one-to-one correspondence with 
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the instruction cache 405 and always outputs the correct fetched instruction type. 
Consequently, the fast single-cycle historic predicted select signal 549 would always 
miscompare with the slower two-cycle predicted select signal 548, in response to which 
Patel teaches that he will delay the instruction fetch operation in order to proceed using 
the slower two-cycle prediction, thereby causing a bubble in the pipeline. Thus, if the 
historic predicted select signal 549 is updated as the Examiner seems to be suggesting, 
any benefit derived from the second embodiment by eliminating the need for the next 
fetch address table 506 would be obtained at the expense of always creating a pipeline 
bubble, which is exactly the problem PatePs invention attempts to solve. Therefore, 
Applicant respectfully asserts that the historic select signal values in the branch target 
address table 518 are not updated based upon a history of whether the return address 
stack 514 mispredicted the target address of a return instruction. 

Second, the most likely manner in which PatePs second embodiment works is that the 
"history" on which the historic predicted select signal 549 is updated is the most recent 
value of the select signal 548 at the current fetch address 504. That is, when the selection 
generation circuitry 526 generates a value of the select signal 548 during the second clock 
cycle in response to a value of the current address 504, Patel also thereafter stores the 
value of the select signal 548 into the branch target address table 5 1 8 entry selected by 
the current address 504 so that the next time the same value of the current address 504 is 
fetched - i.e., so that the next time an instruction is fetched from the same fetch address 
504 value - the branch target address table 518 can provide the previous, i.e., historic, 
value of the select signal 548 on predicted select signal 549 to control the mux 524 one 
cycle earlier than the select signal 548 could control the mux 524. Applicants assert this 
is the most likely meaning of PatePs use of the term "historic" select signal. That is, the 
most likely history Patel uses to populate the branch target address table 518 is the 
previously used value of the select signal 548. This understanding of PatePs second 
embodiment would provide an improvement in target address prediction since most of the 
time the select signal 548 is correct since it is based, at least in part, on the accurate 
instruction types provided by the predecode table 528, which is kept in one-to-one 
correspondence with the instruction cache 405, as discussed above. Thus, the historic 
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predicted select signal 549 would be correct unless the corresponding instruction in the 
instruction cache 405 was overwritten in between the populating of the historic predicted 
select signal 549 value in the branch target address table 518 and the next prediction of 
the instruction (which might occur, for example during an operating system task switch), 
or unless the taken/not taken prediction provided by the branch prediction table 536 were 
incorrect. 

Third, Applicants point out that a reference may only be properly relied on by the 
Examiner for what it does teach, either explicitly or inherently, and it is improper for the 
Examiner to rely upon something a reference does not teach, either explicitly or 
inherently. Patel does not teach explicitly how the historic predicted select signal 549 is 
populated. Furthermore, a reference inherently teaches a limitation only if the limitation 
purportedly inherently taught is the only possible meaning which may be reasonably 
inferred from the explicit teachings of the reference. Thus, Patel does not inherently 
teach the historic predicted select signal 549 being populated with a value to control the 
mux 524 to select the branch target address table 518 rather than the return address stack 
514 if the return address stack 514 historically mispredicted the target address, since 
Applicants have shown at least one other possible, and indeed more likely, manner in 
which Patel' s historic predicted select signal 549 is populated. 

Fourth, Patel only teaches that the branch target address table 518 stores target address 
predictions for unconditional and conditional branch instructions, not for return 
instructions. 

Claims 1-22 

With respect to claim 1, the Examiner stated that Patel teaches that his branch target 
address table 518 provides a prediction of a target address of a return instruction, citing 
col. 6, lines 24-3 1 of Patel. Applicants respectfully assert that col. 6, lines 24-3 1 of Patel 
do not teach (nor do any other portions of Patel teach) that the branch target address table 
518 provides a prediction of a target address of a return instruction. Rather, they merely 
state that the branch target address table 518 provides two branch target addresses (two 
are provided because more than one conditional or unconditional branch instruction may 
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be present in the selected cache line), but not that the target addresses are for a return 
instruction. To the contrary, Patel teaches that the branch target address table 518 
provides target addresses of unconditional and conditional branch instructions, not target 
addresses of return instructions. Thus, the branch target address table 5 1 8 of Patel does 
not anticipate a branch target address cache (BTAC) that provides a prediction of a target 
address of a return instruction, which is a limitation recited in claim 1 . 

Furthermore, with respect to claim 1, the Examiner stated that Patel teaches that his 
branch target address table 5 1 8 provides an override indicator that indicates whether the 
prediction provided by the return address stack mispredicted the target address for a first 
instance of the return instruction, citing col. 7, lines 34-57 and the predicted select signal 
549 of Figure 5. As discussed above, Patel does not teach either at col. 7, lines 36-41 or 
elsewhere that the predicted select signal 549 indicates the return address stack 514 
previously mispredicted the target address of a return instruction. 

Finally, with respect to claim 1, the Examiner stated that Patel teaches that the mux 524 
causes the microprocessor to branch to the target address predicted by the branch target 
address table 518, and not to the target address predicted by the return address stack 514, 
for a second instance of the return instruction, if the predicted select signal 549 indicates 
that the return address stack 5 14 mispredicted the target address on a previous instance of 
the return instruction. This is false. First, as stated above, Patel does not teach that his 
branch target address table 518 stores target address predictions for return instructions. 
Second, as also stated above, Patel does not teach that the predicted select signal 549 
indicates the return address stack 514 mispredicted the target address of a previous 
instance of the return instruction. Third, as also discussed above, the most likely way 
Patel works is that the predicted select signal 549 value stored in, and provided by, the 
branch target address table 5 1 8 the second time the return instruction is fetched is merely 
the value generated on the select signal 548 the first time the return instruction is fetched; 
and, the select signal 548 indicates to select the return address stack 514 address 544 
whenever the predecode table 528 indicates a return instruction type. Therefore, when 
the return instruction is fetched the second time, the predicted select signal 549 will also 
control the mux 524 to select the return address stack 514 target address prediction 544, 



Page 16 of 21 



Application No. 10/679830 (Docket: CNTR.2231) 
37 CFR 1.111 Amendment dated 08/16/2006 
Reply to Office Action of 6/6/2006 

not one of the target address predictions 540/542 provided by the branch target address 
table 518. In other words, the predicted select signal 549 does not instruct the mux 524 
to select a target address from the branch target address table 5 1 8 if the instruction at the 
given fetch address was previously a return instruction; instead, if the instruction was 
previously a return instruction, the mux 524 always selects the target address from the 
return address stack 514. Thus, Patel does not anticipate branch control logic that causes 
the microprocessor to branch to the BTAC target address prediction, and not to the return 
stack target address prediction, for a second instance of the return instruction, if an 
override indicator indicates a predetermined value, which is a limitation recited in claim 
1. 

For these reasons, Applicants respectfully assert that Patel does not anticipate claim 1 
and requests that the Examiner withdraw his rejection to claim 1 . 

With respect to claims 2-22, these claims depend from claim 1 and add further limitations 
that are neither anticipated nor made obvious by Patel. Accordingly, Applicants 
respectfully request that the Examiner withdraw his rejections to claims 2-22. 

With respect to claim 3, as discussed above, Patel does not teach, either at col. 7, lines 
34-57 or elsewhere, of updating an override indicator (asserted by the Examiner to be the 
predicted select signal 549) in a branch target address cache if a return stack mispredicted 
a target address of a return instruction. 

With respect to claim 6, it recites a comparator that compares the target address 
prediction made by the return stack with the target address prediction made by the 
BTAC. With respect to claim 1 the Examiner stated that the return address stack 514 of 
Patel anticipates the claimed return stack and the branch target address table 5 1 8 of Patel 
anticipates the claimed BTAC. Consequently, for the Examiner's assertion to be correct 
that the comparator 550 of Figure 5 anticipates the claimed comparator, the comparator 
550 of Figure 5 of Patel would have to compare the target address 544 provided by the 
return address stack 514 with one of the target address predictions 540/542. However, as 
may be readily observed from Figure 5, the comparator does not do this. Rather, the 
comparator 550 along with the other comparators of Fig. 5 are used by PateFs first 
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embodiment, not by PatePs second embodiment, to compare the next fetch address table 
506 output with each of the four inputs to the mux 524. 

With respect to claims 10 and 11, Applicants can find no teaching in the Abstract of Patel 
regarding instruction decoding, much less a return stack providing a target address 
prediction or a target address prediction being stored into a return stack in response to 
decoding of a return or call instruction, respectively. 

With respect to claim 14, Patel does not teach the return address stack 514 providing its 
prediction 544 in response to the branch target address table 518 providing anything. 
Rather, Figure 5 shows that the return address stack 514 always provides the target 
address 544, and in particular, is not even in communication with the branch target 
address table 518. 

Claims 23-32 

With respect to claim 23, as discussed above with respect to claim 1 and its dependent 
claims, Patel: 1) does not teach a branch target address cache that provides a target 
address prediction for a return instruction; 2) does not teach update logic that updates an 
override indicator if a return stack mispredicted the target address of an occurrence of a 
return instruction; and, 3) does not teach branch control logic that selects a target address 
prediction by the branch target address cache for a second occurrence of the return 
instruction, rather than the return stack prediction, if the override indicator indicates the 
return stack mispredicted the target address of the first occurrence of the return 
instruction; each of which are limitations recited in claim 23. 

Further with respect to claim 23, the Examiner recites col. 8, lines 3-13 of Patel as 
teaching that the mux 524 selects the prediction generated by the branch target address 
table 518 for a second occurrence of a return instruction, rather than selecting the 
prediction generated by the return address stack 514, if the predicted select signal 549 is 
true. This cannot be true since the predicted select signal 549 is only employed in PatePs 
second embodiment, not the first embodiment, and the text of Patel at col. 8, lines 3-13 
describes the flowchart of Figure 6 which illustrates PatePs branch prediction according 
to the first embodiment. 
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With respect to claims 24-32, these claims depend from claim 23 and add further 
limitations that are neither anticipated nor made obvious by Patel. Accordingly, 
Applicants respectfully request that the Examiner withdraw his rejections to claims 24- 
32. 

With respect to claim 28, the predicted select signal 549 is not updated based on whether 
the branch target address table 518 mispredicted a return instruction target address. 
Indeed, as discussed above, the branch target address table 518 does not store predictions 
of target addresses of return instructions and therefore cannot mispredict a target address 
of a return instruction. 

With respect to claims 30 and 35, as discussed above with respect to claim 6, none of the 
comparators, including comparator 550, compare the target address 544 predicted by the 
return address stack 514 with the target addresses 540/542 predicted by the branch target 
address table 518. 

With respect to claims 32 and 35, the mux 524 receives the return address stack 514 
prediction 544 at the same time it receives the branch target address table 518 
predictions, not in different clock cycles. 

Claims 33-45 

With respect to claim 33, as discussed above with respect to claim 1 and its dependent 
claims, Patel: 1) does not teach updating an override indicator if a return stack 
mispredicts the target address of a return instruction; 2) does not teach a branch target 
address cache generating a prediction of a target address of a return instruction; and 3) 
does not teach branching the microprocessor to a target address prediction by the branch 
target address cache if the override indicator indicates the return stack previously 
mispredicted the target address of the return instruction; each of which are limitations 
recited in claim 33. 

Further with respect to claim 33, the Examiner states that a historic select signal implies 
that an indicator would be changed according to history. It is true that the predicted 
select signal 549 is changed according to history. However, as discussed above, Patel 
does not teach which history the predicted select signal 549 is changed according to. 
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And, as discussed above, the most likely history according to which the predicted select 
signal 549 is changed is the previous select signal 548 value, which in no way is based on 
whether or not the return stack mispredicted a return instruction target address. Thus, the 
predicted select signal 549 does not indicate that the return address stack 514 previously 
mispredicted a return target address. 

With respect to claims 34-43, these claims depend from claim 33 and add further 
limitations that are neither anticipated nor made obvious by Patel. Accordingly, 
Applicants respectfully request that the Examiner withdraw his rejections to claims 34- 
43. 

For reasons similar to those discussed above with respect to the other claims, Applicants 
respectfully assert that Patel does not anticipate amended claims 44 and 45. 

Rejections Under 35 U.S.C. §103(a) 

The Examiner rejected claims 17-21 under 35 U.S.C. 103(a) as being unpatentable over 
Patel in view of Gochman et al., U.S. Patent No. 5,964,868 (herein after Gochman). 
Applicants respectfully traverse the Examiner's rejections. 

Claim 17 recites not only a second return stack, but the further limitation that the second 
return stack provides a prediction of the target address of a return instruction. Although 
Gochman teaches a speculative return stack buffer and an actual return stack buffer, 
Gochman' 's actual return stack buffer does not provide a prediction. Rather, Gochman' 's 
actual return stack buffer stores information from fully executed branch instructions 
(which is used for correcting the speculative return stack buffer upon detection of a 
misprediction once the branch instruction is actually executed, not to make a second 
prediction). See Abstract. Thus, Gochman' s actual return stack buffer provides an actual 
correct target address, not a prediction of a target address. 

For these reasons, Applicants respectfully request that the Examiner withdraw his 
rejection to claims 17-21. 
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CONCLUSIONS 

In view of the arguments advance above, Applicants respectfully submit that claims 1-45 
are in condition for allowance. Reconsideration of the rejections is requested, and 
allowance of the claims is solicited. 

Applicants earnestly request that the Examiner contact the undersigned practitioner by 
telephone if the Examiner has any questions or suggestions concerning this amendment, 
the application, or allowance of any claims thereof. 

Respectfully submitted, 

/E. Alan Davis/ 

By: 

E. ALAN DAVIS 
Registration No. 39,954 
Tel: (512)301-7234 

8/16/2006 

Date: 
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